Optimal Paths in Disordered Complex Networks 
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We study the optimal distance in networks, l op t, defined as the length of the path minimizing the 
total weight, in the presence of disorder. Disorder is introduced by assigning random weights to the 
links or nodes. For strong disorder, where the maximal weight along the path dominates the sum, 
we find that ^opt ~ N 1/3 in both Erdos-Renyi (ER) and Watts-Strogatz (WS) networks. For scale 
free (SF) networks, with degree distribution P(k) ~ k~ x , we find that £ op t scales as jV' A ~ 3 ' / '( A ~ 1 ' 
for 3 < A < 4 and as N 1 ^ 3 for A > 4. Thus, for these networks, the small-world nature is destroyed. 
For 2 < A < 3, our numerical results suggest that £ op t scales as In"* 1 " 1 N. We also find numerically 
that for weak disorder £ op t ~ IniV for both the ER and WS models as well as for SF networks. 



PACS numbers: 89.75.Hc 

Recently much attention has been focused on the topic 
of complex networks which characterize marry biological, 
social, and communication systems pj 0, U The net- 
works can be visualized by nodes representing individ- 
uals, organizations, or computers and by links between 
them representing their interactions. 

The classical model for random networks is the Erdos- 
Renyi (ER) model 0, 0| . An important quantity charac- 
terizing networks is the average distance (minimal hop- 
ping) £ m j n between two nodes in the network of total 
N nodes. For the Erdos-Renyi network, and the re- 
lated, more realistic Watts-Strogatz (WS) network @ 
imin scales as In N Q , which leads to the concept of "six 
degrees of separation" . 

In most studies, all links in the network are regarded 
as identical and thus the relevant parameter for infor- 
mation flow including efficient routing, searching, and 
transport is £ m i n - In practice, however, the weights (e.g., 
the quality or cost) of links are usually not equal, and 
thus the length of the optimal path minimizing the sum 
of weights is usually longer than the distance. In many 
cases, the selection of the path is controlled by the sum 
of weights (e.g., total cost) and this case corresponds to 
regular or weak disorder. However, in other cases, for 
example, when a transmission at a constant high rate is 
needed (e.g., in broadcasting video records over the In- 
ternet) the narrowest band link in the path between the 
transmitter and receiver controls the rate of transmission. 
This situation — in which one link controls the selection 
of the path — is called the strong disorder limit. In this 
Letter we show that disorder or inhomogeneity in the 
weight of links may increase the distance dramatically, 
destroying the "small-world" nature of the networks. 

To implement the disorder, we assign a weight or 
"cost" to each link or node. For example, the weight 
could be the time n required to transit the link i. The 
optimal path connecting nodes A and B is the one for 
which ^2 i T i is a minimum. While in weak disorder all 
links contribute to the sum, in strong disorder one term 



dominates it. The strong disorder limit may be naturally 
realized in the vicinity of the absolute zero temperature 
if passing through a link is an activation process with a 
random activation energy e, and Ti = exp(/3ei) , where {3 
is inverse temperature pj- Let us assume that the energy 
spectrum is discrete and that the minimal difference be- 
tween energy levels is Ae. It can be easily shown that 
if (3 > In2/Ae, the value of J2i T i is dominated by the 
largest term, r max . Thus if we have two different paths 
characterized by the sums J2i T i an d J2i T li sucn t^ at 

Tmax > Tmaxi it follows that J^i T t > Y,i T i ■ 

To generate ER graphs, we start with zN links and 
for each link randomly select from the total N(N — l)/2 
possible pairs of nodes a pair that is connected by this 
link. The WS network [|| is implemented by placing the 
N nodes on a circle. Initially, each node i is connected 
with z nodes i + \,i + 2, + z and periodic boundaries 
are implemented. Thus each node has a degree 2z and the 
total number of links is zN . Next we randomly remove a 
fraction p of the links and use them to connect randomly- 
selected pairs of nodes. When p = 1, we obtain a model 
very similar to the ER graph. 

To generate scale-free (SF) graphs, we employ the 
Molloy-Reed algorithm [9j in which each node is first as- 
signed a random integer k from a power law distribution 
P(k > k) = (k/ko)~ +1 , where ko is the minimal number 
of links for each node. Next we randomly select a node 
and try to connect each of its k links with randomly se- 
lected k nodes that still have free positions for links. 

We expect that the optimal path length in the weak 
disorder case will not be considerably different from the 
shortest path, as found for regular lattices 01 an d ran- 
dom graphs [Tj . Thus we expect that the scaling for the 
shortest path £ m i n ~ In AT will also be valid for the opti- 
mal path in weak disorder, but with a different prefactor 
depending on the details of the graph. 

In the case of strong disorder, we present the follow- 
ing theoretical arguments. Cieplak et al.0] showed that 
finding the optimal path between nodes A and B in the 
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strong disorder limit is equivalent to the following pro- 
cedure. First, we sort all M links of the network in the 
descending order of their weights, so that the first link 
in this list has the largest weight. Since the sum of the 
weights on any path between nodes A and B is domi- 
nated by a single link with the largest weight, the op- 
timal path cannot go through the first link in the list, 
provided there is a path between A and B which avoids 
this link. Thus the first link in the list can be eliminated 
and now our problem is reduced to the problem of find- 
ing the minimal path on the network of M — 1 links. We 
can continue to remove links from the top of the list one 
by one until we pick a link whose removal destroys the 
connectivity between A and B. This means that all the 
remaining paths between A and B go through this singly- 
connecting or "red" link J13J and all these paths have the 
same largest weight corresponding to the "red" link. To 
continue optimization among these paths we must select 
the paths with the minimal second largest term, minimal 
third largest term and so on. So we must continue to 
remove links in the descending order of their weights un- 
less they are "red" until a single path between A and B, 
consisting of only "red" links remains. Since the assign- 
ing of weights to the links is random so is their ordering. 
Hence the optimization procedure in the strong disorder 
limit is statistically equivalent to removing the links in 
random order unless the connectivity between nodes A 
and B is destroyed. 

At the beginning of this process, the chances of losing 
connectivity by removing a random link are very low, 
so the process corresponds exactly to diluting the net- 
work, which is identical to the percolation model. Only 
when the concentration of the remaining links approaches 
the percolation threshold will the chances of removing a 
singly-connected "red" link become significant, indi- 
cating that the optimal path must be on the percolation 
backbone connecting A and B. Since the network is not 
embedded in space but has an infinite dimensionality, we 
expect from percolation theory that loops are not rele- 
vant at criticality 01- Thus, the shortest path must also 
be the optimal path. 

We begin by considering the case of the ER graph that, 
at criticality, is equivalent to percolation on the Cayley 
tree or percolation at the upper critical dimension d c = 6. 
For the ER graph, it is known that the mass of the incip- 
ient infinite cluster S scales as 7V 2//3 Q. This result can 
also be obtained in the framework of percolation theory 
for d c = 6. Since S ~ R d f and N ~ R d (where dj is the 
fractal dimension and R the diameter of the cluster), it 
follows that S ~ N d f/ d and for d c = 6, d f = 4 [l| 

S ~ N 2/3 . (1) 

It is also known |l5j| that, at criticality, at the upper 
critical dimension, S ~ £^- ln with di = 2, 15] and thus 

twin ~ topt ~ S 1/de ~ N 2/3de ~ AT^opt ; ( 2 ) 
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FIG. 1: Scaling plot of £ op t on WS graphs for weak disorder as 
a function In N/no for various values of p and z = 2. The inset 
shows the log-log plot of no versus pz. The different symbols 
represent different p values: p — 0.001 (A), p = 0.002 (*), 
p = 0.004 (o), p = 0.008 (v), P = 0.016 (+), p = 0.032 (•) 
p — 0.064 (o), and p — 0.128 (□). Similar results have been 
obtained for 2 = 1,4, and 8. Those results scale according to 
Eq. QJ. 

for large N and large p will be in the same universality 
class as ER. 

For SF networks, we can also use the percolation re- 
sults at criticality. It was found 0] that dg = 2 for 
A > 4, d t = (A - 2)/(A - 3) for 3 < A < 4, S ~ N 2 / 3 for 
A > 4, and S ~ N^- 2 ^'-^ for 3 < A < 4. Hence, we 
conclude that 

I ■ ~£ ♦ ~ / ^ 1/3 A > 4 f3l 

lmin ^p* \ jy(A-3)/(A-i) 3 < A < 4 ' 1 ' 

To test these theoretical predictions, we perform numer- 
ical simulations in the strong disorder limit by randomly 
removing links (or nodes) for ER WS, and SF networks 
and use the Dijkstra algorithm [jjfl for the weak disorder 
case. We also perform additional simulations for the case 
of strong disorder on ER networks using direct optimiza- 
tion with Dijkstra algorithm of the sum of weights and 
find results identical to the results obtained by randomly 
removing links, see Fig. 2a. 

Results for weak disorder for WS graphs with different 
p are shown in Fig. 1. We propose a scaling formula for 
£ op t similar to the formula derived in [Tsl Il9| | for the min- 
imal distance on the WS graphs with a different rewiring 
probability p 

•-"Trf'f-ri)' < 4) 

ni(z) \n [p,z)J 

where no(p, z) ~ 1/pz is the characteristic graph size at 
which the crossover from large to small world behavior 
occurs, n\(z) ~ z is a correction factor, and F(x) is the 
scaling function 



where ^ op t = 2/3dt = 1/3. We expect that the WS model 
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FIG. 2: (a) The dependence of £ opt on iV 1/3 
the strong disorder case obtained by direct 
and by randomly removing links (o). The 
has a slope of 3.27. Also shown are the 
multiplied by 50 for direct optimization ( x ) 
removing links (•). (b) Scaling plot of £ op t 
strong disorder as a function (JV/n ) 1/3 for 
p and z = 2. The symbols indicating values 
as in Fig. 1. The inset shows a log- log plot 

2 = 2. 
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FIG. 3: (a) The dependence of £ op t on In AT for SF graphs in 
the weak disorder case for various values of A shown on the 
graph. The behavior of the asymptotic slope versus A shown 
as an inset, (b) The dependence of £ op t on £ m i n . The curves 
from left to right represent increasing values of A given in (a). 
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FIG. 4: (a) The dependence of £ opt on N 1/3 for A > 4. (b) 
The dependence of £ opt /lnN on N 1/s for A = 4. (c) The 
dependence of £ opt on aK*-3)/(a-i) f or 3 < > < 4. (d) The 
dependence of £ op t on In iV for A < 3. 



The scaling variable x = N/uq indicates the number of 
nodes with long range links. As p — > 0, this quantity 
scales as Npz. The quantity nn(p, z) ~ 1/pz indicates 
a typical short-range neighborhood of a node with long 
range links. We can think about this graph as an ER 
graph consisting of iV/nn effective nodes, each represent- 
ing a typical short-range chain-like neighborhood of size 
no. Thus we conclude that an optimal path connecting 
any two nodes is proportional to ]xi{N/no), as in an ER 
graph, times an average path length through a chain of 
short-range links. This average path is proportional to 
the length of this chain no and inversely proportional to 
the average range nx(z) of a link in this chain. Ideally 
rti(z) = z, but in reality it can significantly deviate from 
z due to finite size effects. Figure 1 shows the scaled 
optimal path £ opt / no versus the scaled variable N / no for 
z = 2 and different values of p. The inset in Fig. 1 shows 
that no ~ 1/pz as p — > 0. 

In contrast, for Eq. JIJ to be in agreement with Eq. 



for the strong disorder limit, we have (see Fig. 2), 

F{x)~t xl/3 (6) 
(_ x x — > 

For large enough z and p — > 1 , we recover ER network for 
which £ Qp t does not depend on z. Thus we can assume 
nn(l, z) — 1. Using similar scaling arguments as in case of 
weak disorder, we assume that as p — > 0, l op t ~ z~ 2 / 3 N, 
and hence n\{z) ~ z 2 / 3 . 

For SF networks, the behavior of the optimal path in 
the weak disorder limit is shown in Fig. 3 for different 
degree distribution exponents A. Here we plot £ opt as a 
function of In N. All the curves have linear asymptotes, 
but the slopes depend on A, 

L P t ~/(A)lnJV. (7) 

This result is analogous to the behavior of the shortest 
path £ miD — In N for 3 < A < 4. However, for 2 < A < 3, 
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£ m in scales as In In TV [2(j while £ pt is significantly larger 
and scales as In N (Fig. 3b). Thus weak disorder does not 
change the universality class of the length of the optimal 
path except in the case of "ultra-small" worlds 2 < A < 3. 

In contrast, strong disorder dramatically changes the 
universality class of the optimal path. Theoretical con- 
siderations [Eqs. J2J an d ©] predict that in the case 
of WS and ER (Fig. 2) and SF graphs with A > 4, 
£ opt = TV 1 / 3 , while for SF graphs with 3 < A < 4, 
£ opt ~ N^- 3 )/^- 1 ), Figure 4a shows the linear be- 
havior of £ opt versus TV 1 / 3 for A > 4. The quality of 
the linear fit becomes poor for A — > 4. At this value, 
the logarithmic divergence of the second moment of the 
degree distribution occurs and one expects logarithmic 
corrections, i.e., £ opt ~ A 1 / 3 / In A (see Fig. 4b). Fig- 
ure 4c shows the asymptotic linear behavior of £ op t ver- 
sus AK*- 3 )/^- 1 ) for 3 < A < 4. Theoretically, as A -> 3, 
v op t = (A — 3)/(A — 1) — ► 0, and thus one can expect for 
A = 3 a logarithmic dependence of £ opt versus A. In- 
terestingly, for 2 < A < 3 our numerical results for the 
strong disorder limit suggest that £ op t scales faster than 
In A. The numerical results can be fit to £ op t ~ (In TV) A_1 
(see Fig. 4d). Note that the correct asymptotic behav- 
ior may be different and this result represents only a 
crossover regime. We obtain the same results for the SF 
networks in which the weights are associated with nodes 
rather then links. The exact nature of the percolation 



cluster at A < 3 is not clear, since in this regime the 
tarnsition does not occur at a finite concentration [l4| . 

In summary, we study the optimal distance in ER, WS, 
and SF networks in the presence of strong and weak 
disorder. We find that in ER and WS networks and 
for strong disorder, the optimal distance £ opt scales as 
TV 1 / 3 . We also study the strong disorder limit in SF 
networks theoretically and by simulations and find that 
4 pt scales as TV 1 / 3 for A > 4 and as jv(*-3)/(A-i) for 
3 < A < 4. Thus, the optimal distance increases dra- 
matically in strong disorder when it is compared to the 
known small world result £ m in ~ In TV and the "small 
world" nature for these networks is destroyed. Our sim- 
ulations also suggest that for 2 < A < 3, £ op t scales as 
ln A_1 TV, which is also much faster than the "ultra-small 
world" result £ m \n ~ ln(lnTV) |2jj. We also find numer- 
ically that in weak disorder £ opt ~ In TV in all types of 
networks studied. 
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